Skinner Operant Conditioning Model and Robot Bionic Self-learning Control
نویسندگان
چکیده
Original scientific paper A Fuzzy Skinner Operant Conditioning Automaton (FSOCA) is constructed based on Operant Conditioning Mechanism with Fuzzy Set theory. The main character of FSOCA automaton is: the fuzzed results of state by Gaussian function are used as fuzzy state sets; the fuzzy mapping rules of fuzzyconditioning-operation replace the stochastic "conditioning-operant" mapping sets. So the FSOCA automaton can be used to describe, simulate and design various self-organization actions of a fuzzy uncertain system. The FSOCA automaton firstly adopts online clustering algorithm to divide the input space and uses the excitation intensity of mapping rule to decide whether a new mapping rule needs to be generated in order to ensure that the number of mapping rules is economical. The designed FSOCA automaton is applied to motion balanced control of two-wheeled robot. With the learning proceeding, the selected probability of the optimal consequent fuzzy operant will gradually increase, the fuzzy operant action entropy will gradually decrease and the fuzzy mapping rules will automatically be generated and deleted. After about seventeen rounds of training, the selected probabilities of fuzzy consequent optimal operant gradually tend to one, the fuzzy operant action entropy gradually tends to minimum and the number of fuzzy mapping rules is optimum. So the robot gradually learns the motion balance skill.
منابع مشابه
A study on the cognitive model of robot sensorimotor system
A cognitive model for sensorimotor system of self-rebalancing robot is presented based on Skinner operant conditioning principle. The model mainly consists of three parts, which are cerebellum, basal ganglia and cerebral cortex. In the model, the cerebellum realizes the mapping from sensorimotor states to actions by supervised learning mechanism, the basal ganglia decides the proper action base...
متن کاملSpontaneous decisions and operant conditioning in fruit flies.
Already in the 1930s Skinner, Konorski and colleagues debated the commonalities, differences and interactions among the processes underlying what was then known as "conditioned reflexes type I and II", but which is today more well-known as classical (Pavlovian) and operant (instrumental) conditioning. Subsequent decades of research have confirmed that the interactions between the various learni...
متن کاملOperant Conditioning: An Overview
Classical, or Pavlovian, conditioning is a process by which new emotional and glandular reactions develop in response to previously neutral stimuli in the environment. But classical conditioning doesn't explain how we develop new skills or behaviors instrumental in changing our external environments. That learning process involves what is typically referred to as instrumental, or operant, condi...
متن کاملBionic Robot Control based on Advanced Updating
In view of the balance control problem of self-balance robot, the reinforcement learning mechanism based on the advanced updating is proposed as a self-balance bionic learning algorithm of the robot. This algorithm can choose optimal behavior above the baseline with the certain probability by using baseline in the advanced updating and unifying the probability curiosity mechanism in reinforceme...
متن کامل